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Try not to have a good time . . . This is supposed to be educational. " 

Charles Schulz 



1 Introduction 

1.1 Dynamic Variables and Parameters 

Since the discovery of Newton's equation and its application to the study of the Solar 
System, it has become apparent that an important number of physical problems could be 
modeled, more or less accurately, by ordinary differential equations (ODEs). Sometimes, 
these equations are direct consequences of the fundamental laws of Physics, like Newton's 
equation (for classical mechanical systems) or Maxwell's equations (for electromagnetic 
problems). Macroscopic systems, for which we cannot neglect the fact that they are 
composed of a very large number of atoms or molecules, may sometimes be modeled by 
somewhat more phenomenological laws, taking into account the interaction of a small 
number of effective degrees of freedom. This applies to the equations of thermodynamics 
(applicable for instance to kinetics of chemical reactions), master equations (lasers) or 
mean field equations (phase transitions). There also exist a number of systems, which are 
not directly related to Physics, but are nevertheless modeled, on a very phenomenological 
level, by ODEs: this is the case, for instance, for population dynamics in ecology. 

When we consider some specific examples, like those given in Table 0, we realize that 
such differential equations will depend on two kinds of variables: dynamic variables and 
parameters. As far as the mathematical model is concerned, the distinction between 
these two types of variables is clear: 

• dynamic variables define the state of the system; their role is twofold: on one hand, 
they evolve in time, specifying the state of the system at each instant; on the other 
hand, they determine the future evolution of the system; 

• parameters also influence the future evolution, but their value remains fixed; in fact, 
a different dynamical system is obtained for each value of the parameters. 



System 


Dynamic variables 


Parameters 


Mechanical system 


Positions and momenta 


External driving force 


Electric device 


Charges and currents 


Power supply, 
tunable resistance 


Chemical reaction 


Concentration of 
reacting substances 


Supply flux, 
temperature 


Laser 


Level population, 
internal field 


External field 


Magnet 


Order parameter 
(magnetization) 


Magnetic field, 
temperature 


Population dynamics 


Number of individuals 
of each species 


Climate, 

reproduction rate 



Table 1. Examples of systems which can be modeled by ODEs, with associated dynamic 
variables and parameters. 
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Are the "parameters" of Table [T] really always fixed? Let us examine more closely different 
kinds of parameters which may appear in a physical experiment. We may distinguish the 
following types: 

• parameters which are related to physical constants or technical specifications of the 
experimental set-up, and are, therefore, fixed during the experiment; this applies to 
masses and coupling constants of particles, and dimensions of a cavity or reactor; 

• control parameters, which can be accurately tuned, say by turning a knob of the 
experimental device; this may be the case for the supply voltage of an electric device, 
an applied external field, or the temperature difference between two sides of a cavity; 

• parameters that one would like to maintain fixed, but which are not so easy to control 
in a real experiment, like a supply flux of chemicals, or the temperature in a reactor. 

One usually characterizes a dynamical system by its bifurcation diagram, representing 
the asymptotic state (which may be stationary, periodic or more complicated) against the 
control parameter (Fig. |l]). What do we mean when we say that the bifurcation diagram 
is determined experimentally by varying the control parameter? 

According to the mathematical modeling, the bifurcation diagram should be deter- 
mined as follows. Fix the control parameter and choose an initial state for the system. 
Let the system evolve until it has reached an asymptotic state. Repeat this procedure for 
different initial conditions, in order to find other possible asymptotic states. Then increase 
the control parameter, reset the initial state, and repeat the whole experiment. Apply this 
procedure for the desired set of parameter values, and plot the asymptotic state(s) against 
the control parameter. 

In practice, it is not always possible to carry out this rather elaborate program. We 
may not have the time to wait for the system relaxing to equilibrium for each parameter 
value, or we may not be able to reset the initial condition. In fact, it is very tempting^] to 
turn slowly the knob controlling the parameter during the experiment, in the hope that if 
this parameter variation is sufficiently slow, it will not affect the bifurcation diagram very 
much. 

Is this hope justified? The answer to this question is not immediate at all. It requires 
a precise understanding of the relation that exists between, on one hand, a one-parameter 
family of autonomous Dynamical Systems and, on the other hand, the system with slowly 
time-dependent parameter. This relation is by no means trivial in all cases, since memory 
effects, in particular hysteresis, may show up in such systems. An understanding of this 
relation would allow us, for example, to solve the following problems: 

• If the control parameter is swept slowly in time, do we obtain a trustworthy represen- 
tation of the bifurcation diagram? 

• How do parameters, which cannot be controlled completely, but are subject to slow 
fluctuations, affect our modeling of the system? 

• Consider a system subject to a slowly time-dependent driving force. Can we use 
the static bifurcation diagram (which is analytically more tractable) to gain some 
information on the time-dependent system? 

To deal with this kind of questions, we should begin by understanding the role of time 
scales in Physics. 



1 Every person who has ever seen an experimental device with a knob for the control parameter knows 
that it is indeed very difficult not to turn this knob during the experiment. 
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asymptotic 
state 



parameter 

FIGURE 1. Example of a bifurcation diagram. For each value of the parameter, one plots 
the asymptotic state of the system. In this example, there is a unique stable equilibrium 
state for small parameter (thick full line). At some parameter value, this equilibrium 
becomes unstable (dotted line), while two new stable equilibria are formed. One of them 
is then replaced by a limit cycle, i.e., a stable periodic orbit. To determine this diagram 
experimentally, one should fix a value of the parameter and an initial condition, and wait 
for the system to relax to equilibrium (vertical arrows) . This procedure should be repeated 
for several parameter values. 



1.2 Slow-Fast Systems and Hysteresis 

Physical systems are often characterized by one or several time scales. A characteristic time 
might be the period of a typical periodic solution, or the relaxation time to equilibrium. 
Let us consider a dynamical system with characteristic time T 1: called the fast system, 
and couple it to another system with much larger characteristic time T 2 » T 1: called the 
slow system. 

Two particular situations are of interest: 

1. The evolution of the slow system is imposed from outside, and acts on the fast system 
as a slowly time-dependent parameter. For this purpose, it need not be governed by 
a differential equation. We call this coupled system an adiabatic system. 

2. The slow system is also a dynamical system, which is coupled to and influenced by 
the fast one. In this situation, we speak of a slow— fast system. 

As an illustration, let us imagine the following population model. In some relatively 
small ecosystem, predators and prey reproduce, say, a couple of times a year. Their 
populations have attained a cyclic regime, with a period of a few years. Now the climate 
begins to change slowly, due for instance to human impact, modifying the reproduction 
rate of the predator. This would be an example of an adiabatic system, since the climate 
change is imposed from outside. Another situation appears when, due to continual food 
consumption by the prey, vegetation and micro- climate are slowly modified, changing the 
reproduction rates in turn. This would be an example of a slow-fast system. 

In this work, we are mainly interested in adiabatic systems. We believe, however, that 
most results can be transposed to slow-fast systems (see Chapter 4). 

What do we expect from the behaviour of an adiabatic system? To fix the ideas, we can 
keep in mind the example of the motion of a damped particle, in a slowly time-dependent 
potential. Let us first examine the case when the static system (obtained by freezing the 
potential) admits a stable stationary state (a potential minimum), depending smoothly on 
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FIGURE 2. The damped motion of a particle in a slowly varying potential provides a 
simple example of adiabatic system. If the potential admits an isolated, slowly moving 
minimum, the particle will follow this well adiabatically (a). Bifurcations correspond to 
situations where this minimum interacts with other equilibrium points. For instance, the 
minimum may annihilate with a maximum (saddle-node bifurcation), and the particle 
leaves the vicinity of the bifurcation point (b). We may also have creation of two new 
equilibria (direct pitchfork bifurcation), so that the particle has to choose between its 
current, unstable position, and two potential wells (c). Or the minimum may disappear in 
favor of a maximum (indirect pitchfork bifurcation) (d). 



the parameter. When the parameter is fixed, orbits starting in its neighborhood will relax 
to this equilibrium. When the parameter is swept slowly in time, it is generally believed 
that the orbit will follow the equilibrium curve adiabatically, i.e., the particle will remain 
close (in a sense to be made precise later) to the potential minimum. 

This behaviour has the following physical interpretation: in the adiabatic limit, the 
asymptotic state will be identical with the static equilibrium curve. In other words, the 
fast system is enslaved by the slow one, its state being entirely determined by the value 
of the slow variables (i.e., the parameters)^] 

New phenomena arise when the equilibrium loses stability, a situation known as bifur- 
cation. Different scenarios are possible (Fig. ||): the equilibrium may simply disappear, 
or it may become unstable after interacting with one or several other equilibria. The 
particle's motion depends a lot on the local structure of the bifurcation. In some cases, it 
leaves the vicinity of the bifurcation point, until reaching some other equilibrium or limit 
cycle. It may also follow a new equilibrium branch created in the bifurcation, or even re- 
main close to an unstable equilibrium for some time, a phenomenon known as bifurcation 
delay, which can be interpreted as metastability. These problems belong to the field of 
dynamic bifurcations, which has received much attention in recent years. 

These local features of dynamics have a strong influence on global properties. Let 
us focus on the situation when the parameter is varied periodically in time. Without 
bifurcations, the solution will merely follow the periodic motion of a stable equilibrium, 
independently of whether the parameter is increasing or decreasing. The situation changes 
in presence of bifurcations. It may happen, for instance, that the fast system follows a 
different equilibrium branch for increasing or decreasing parameter. This phenomenon is 
known as hysteresis: the asymptotic state depends not only on the present value of the 
parameter, but also on its history (Fig. ^). 

2 To avoid a confusion due to terminology, we point out that in thermodynamics, such a motion will be 
called quasistatic rather than adiabatic. 
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Figure 3. Example of a bifurcation diagram leading to hysteresis (a similar diagram is 
found in [WiQ. It can be seen as a combination of the bifurcations in Fig. ||b and d. For 
increasing parameter, the solution follows the stable origin at least until the bifurcation 
(in fact, we will see that it may even follow the unstable origin for some time). When it 
finally reaches the new stable branch, and the parameter is decreased again, is stays close 
to this branch down to a smaller value of the parameter, hence describing a hysteresis 
cycle. 



Hysteresis can be interpreted as the non-commutation of two limits, the asymptotic 
and the adiabatic one. Mathematically, it is easier to take the adiabatic limit first, which 
amounts to freezing the slow system. The motion of the fast system is then governed by 
an autonomous (closed) equation, and taking the asymptotic limit merely corresponds to 
analysing its equilibria (or other attractors). 

This is, however, not the physically interesting information. We would like instead to 
fix some small, but positive frequency of the parameter variation, and study the asymptotic 
motion of the time-dependent fast system (whatever this motion may be) . Then we would 
like to determine how this asymptotic motion behaves in the adiabatic limit, i.e., when 
the frequency of parameter variation goes to zero. 

Without bifurcation, the two limits can be taken in either order: the asymptotic motion 
will approach a simple function of the parameter in the adiabatic limit (see Example |] 
below). In presence of bifurcations, hysteresis may occur. This is the central topic of 
this work. To understand how hysteresis arises in adiabatic Dynamical Systems, we first 
need to develop methods which enable us to determine solutions for small, but positive 
parameter sweeping rates. In particular, we have to understand if, for a periodically varied 
parameter, these solutions tend asymptotically to periodic ones, or if more complicated 
dynamics are possible. Then we will be able to study their behaviour in the adiabatic 
limit. 

1.3 Historical Account 

We have no intention of giving here an exhaustive historical account of the theory of 
Dynamical Systems with multiple time scales. Besides the fact that such an exposition 
would take many pages, we do not feel sufficiently well acquainted with the multiple aspects 
of this large domain to be able to cite correctly the numerous researchers who contributed 
to one (or several) of its facets. Instead, we would like to mention at this place the major 
sources of inspiration of this work. 

Research on adiabatic systems, hysteresis and related subjects appears to have been 
pursued almost independently by mathematicians and physicists. The former have been 
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mostly interested in slow-fast systems, adiabatic invariants and, more recently, in dynamic 
bifurcations and bifurcation delay. The latter have rediscovered several times during this 
century the importance of adiabatic systems. Recently, there has been renewed interest in 
hysteresis appearing in lasers and magnets. Different models have been considered, and 
studied mainly by numerical methods. 



Mathematics: slow fast systems and bifurcation delay 

Slow-fast systems have been studied almost since the beginning of differential equations 
theory itself. They appear naturally in perturbed integrable systems, where angle variables 
define the fast system, and action variables the slow one. For instance, in the Solar System, 
fast variables describe the motion of planets in their orbits, while slow variables describe 
the spatial orientation of these orbits.^] When the interaction between planets is neglected, 
these orbits are frozen in space, whereas they begin to deform slowly in time when their 
interaction is taken into account. 

Research on these systems has mainly focused on the dynamics of slow variables. The 
method of averaging, for instance, aims at replacing the dynamics of the slow variables by 



an effective equation, where the fast variables have been averaged out [ Ax2 |. One often 
tries to construct adiabatic invariants, which are functions on phase space remaining 
(almost) constant in time. A highlight of this line of research is the celebrated Kolmogorov- 
Arnol'd— Moser (KAM) theorem, which proves the existence of exact adiabatic invariants 
for some initial conditions. 

Adiabatic dynamics have been, for a long time, mainly studied in relation with quan- 
tum mechanics perry ). The quantum adiabatic theorem states that solutions of the 



slowly time-dependent Schrodinger equation will adiabatically follow the eigenspaces of 
the instantaneous Hamiltonian. Although this problem is relatively old, rigorous proofs 



have been given only very recently | JKP ). Classical adiabatic systems (mostly linear ones) 



have been studied in some detail by Wasow [Wa|. 



An early result on nonlinear slow-fast systems is due to Pontryagin and Rodygin [ PR ] 
in 1960. They showed that orbits of the fast system, which start sufficiently close to a 
stable equilibrium or limit cycle, will follow this attractor adiabatically. Problems involving 
bifurcations seem to have been studied for the first time by Lebovitz and Schaar |LS}| in 
1977. They considered problems where two equilibrium branches exchange stability, and 
showed that under some generic conditions, the orbit will follow a stable branch after the 
bifurcation. 



In 1979, Haberman Habfl considered a class of one and two-dimensional problems. He 



introduced the notion of slowly varying states, computed as series in the adiabatic param- 
eter, and studied in particular jump phenomena (also known as catastrophes) occurring 
near saddle-node bifurcations. 

The topic which would soon be given the name of dynamic bifurcations developed 
rapidly in the second half of the eighties. The importance of the bifurcation delay 
phenomenon in various physical situations (lasers, neurons) was emphasized by Mandel, 



Erneux and co-workers [ME1, ME2, BER], who derived an approximate formula for the 
delay time using slowly varying states. This phenomenon, and the related problem of 
ducks (also called canards) were then studied by several mathematicians, using non- 



standard analysis (see [ Benj| for a summary of these works and a more detailed history) . 

DD for a non-technical discussion. 



See for instance Laskar's article in 
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A common feature of most of these works, including Wasow's, is that the authors 
try to construct particular solutions as series in the adiabatic parameter. The problem 
is, however, that these series are in general not convergent. A naive treatment of such 
equations may therefore yield, in some cases, incorrect results. In order to obtain the 
right answers with these methods (for instance the fact that there exists a maximal value 
for the bifurcation delay), one has to use rather elaborate techniques, as resummation 
of divergent series (see |Ben |, in particular the articles by Diener and Diener, and by 
Canalis-Durand) . 



An entirely new direction to treat these problems was initiated by Neishtadt [ Nel , Ne2 ] . 
Returning to the old technique of successive changes of variables, but combined with 
estimations inspired by Nekhoroshev, he was able to prove rigorously the existence of a 
bifurcation delay. Moreover, with the help of a technique involving deformation of an 
integration path into the complex plane, he could give an explicit lower bound to the 
delay time. Diener and Diener | Benf have examined under which generic conditions this 
formula gives an upper bound as well. 

Recently, these results have been generalized to the case of a periodic orbit undergoing 
Hopf bifurcation [NST] . 



Physics: hysteresis and scaling laws 

Research on hysteresis has been pursued by physicists, almost independently of mathe- 
maticians, and mostly with numerical methods. For a long time, the standard model for 



hysteretic phenomena has been the Preisach model [ May , MNZ |. This model, however, 
is artificial and provides no derivation of hysteresis from microscopic principles. 

Interest in microscopic models of magnetic hysteresis was renewed in 1990, by an 
important article by Rao, Krishnamurthy and Pandit [RKP]. They analyse numerically 
two models, an Ising model with Monte-Carlo dynamics, and a continuous model with 
O(JV) symmetry in the large ./V limit. They proposed in particular that the area A enclosed 
by the hysteresis cycle should scale with the amplitude H of the magnetic field and its 
frequency according to the power law A ~ H°OP, where a ~ 0.66 and ~ 0.33 for 
small frequency and amplitude. 

This work inspired a large number of articles trying to exhibit scaling laws for hysteresis 
cycles. In the case of a laser system [JGRM], analytical arguments showed that a one- 
dimensional model equation admits a hysteresis cycle with area A(£l) ~ A(0) + f2 2 / 3 . The 
discrepancy between this result and the one in 
controversy 



RKP | lead in following years to some 



Still in the year 1990, a numerical study of a mean field approximation of the Ising 
model introduced the concept of a dynamic phase transition [PO|: regions with zero 
and non-zero average magnetization by cycle are separated by a transition line in the 
temperature-magnetic-field-amplitude plane. 

These papers were followed by various numerical simulations (on lattice models and 
continuous ones) and experiments, which proposed new sets of exponents. We show some 
of them in Table ^. The trouble is that even for one and the same model, these exponents 
differ widely from one experiment to the other. 

There have been several attempts to derive these exponents analytically. Relatively 
simple systems, like lasers, seem to be described satisfactorily by one-dimensional equa- 
tions, as shown in [ HLfc , GBS] which extend results in [ JGRM ]. However, for magnetic 
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System 



Scaling of A 



Iron [[Steij 
Fe/Au film |HW | 
Co/Cu filmJjTW| 
Fe/W film fSE] 



#0.59^0.31 

A + (i? 2 - F 2 ) - 34 ^ - 66 



Experiments 



^0.25^0.03 



^0.66^0.33 

A + ft - 7 

#0.46^0.36 

A + ^°- 36 

^0.7^0.36 

A + ^ a66 
A + H° m n ot 



Numerical simulations 



(<I» 2 ) 2 model jRKP| 
($ 2 ) 2 model jZZSl 
($ 2 ) 3 model |ZZS | 



Ising 2D Monte-Carlo 
Ising 2D Monte-Carlo 
Ising 2D Monte-Carlo 
Ising 3D Monte-Carlo 
Cell-dynamical system 
Mean field 




ZZL 



A + (# 2 - # c 2 ) 1/3 tt 2/3 
i^V/ 2 

llnQI- 1 /^-!) 



Analytical arguments 



Mean field HJGRMfl 
($ 2 ) 2 model fDTj 
($ 2 ) 2 model flSDfl 
($ 2 ) 2 model |ZZ2] 



Ising dD [pRN ] 



Table 2. Some results on the scaling behaviour of the area A enclosed by a hysteresis 
cycle, as a function of magnetic field amplitude H and frequency £1. Recent experiments 
were made with ultrathin films. Numerical Monte-Carlo simulations have been carried 
out on the two-dimensional (2D) and three-dimensional (3D) Ising model with Glauber 
dynamics. Other numerical experiments concern the Langevin equation in a Ginzburg- 
Landau (<f> 2 ) 2 or (<I> 2 ) 3 potential with O(N) symmetry. In the large N limit, the noise 
can be eliminated from the equation, and one obtains deterministic ODE. The proposed 
exponents differ a lot from one experiment to another. In particular, it is not clear whether 
the area should go to zero, or to a finite limit A when f2 — > 0. It is amusing to note that 
results of one experiment [JYW| could be fitted on the mean field result [IGRM], while 
another one [ETW] was fitted on results of the (<I> 2 ) 2 model studied in [ RKP[ . Although 
the mean-field studies in [JGRM] and [LZ] predict the same O-dependence, they do not 
agree on the 7? -dependence. In fact, we will show that both laws are incorrect. 
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systems, no satisfactory explanation has been obtained. Some analytical arguments, us- 
ing rescaling [SD] or renormalization |ZZ2 | seem to indicate that the area should scale 



as A ~ H^ 2 Q}/ 2 . Various explanations have been proposed for these discrepancies, for 



instance logarithmic corrections [ DT | 



In fact, it is not clear at all whether the area should really follow a power law [SRN]. It 



depends probably in a crucial way on the detailed dynamics of droplets during magnetiza- 
tion reversal. At any rate, understanding how these scaling laws may appear in the model 
equations would be a good criterion to test their adequacy against real physical systems. 



Recently, several authors have introduced other models, including quantum effects |BDSf| ; 
they have also become interested in other indicators, like pulse susceptibility [ |AC2 ], 



2 Mathematical Formulation 

2.1 Adiabatic Systems and Slow— Fast Systems 

We will consider dynamical systems described by ordinary differential equations of the 
form 

^ t =f(xA), (i) 

where x G K" is the vector of dynamic variables, and A G M p is a set of parameters. We 
shall assume that / is a function of class C 2 at least. 

The slow variation of parameters is described by a function G(et), where < e <C 1 is 
the adiabatic parameter: 

n t 

- = f( x ,G(et)). (2) 

This formulation should be interpreted as follows: f(x, A) and G{t) are given functions, 
fixed once and for all,Q and we would like to understand the behaviour of (Q) in the 
adiabatic limit e — > 0. For instance, G(et) = sin(et) would describe a periodic variation 
of the parameter, with small frequency e. 

The adiabatic limit should be taken with some care. If we naively replace e by in 
(|2|), we obtain the autonomous system 4| = f(x, G(0)). This is due to the fact that with 
respect to the slow time scale, we have zoomed on a particular instant. This is not what 
we are interested in: it is more natural, for our purpose, to study the system on the slow 
time scale of parameter variation. We do that by introducing a slow time r = et, so that 
@ can be rewritten 

n t 

e—=:sx = f(x,G(r)). (3) 
dr 

We call this equation an adiabatic system. In the adiabatic limit, it reduces to the 
algebraic equation f(x,G(r)) = 0. We will see that although this limit is singular, it is 
less problematic to analyse than for (||). 

4 One may, in fact, allow for an e-dependence of /, provided / behaves smoothly (in some sense) in the 
limit e — » 0, see Section 4.1. 
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By contrast, a slow— fast system is described by a set of coupled ODE of the form 



ex = f(x,y) 

y = g(x,y). 

In some circumstances, adiabatic and slow-fast systems are equivalent and may be trans- 
formed into one another. For instance, if G(t) is the solution of a differential equation 
V = 9{y)i the adiabatic system (||) can be transformed into a slow-fast system. If A E R, 
this transformation is only possible for monotonous G{t). There are other ways to write 
@ as a vector field, for instance by considering the slow time r as a dynamic variable 
(see next subsection). In some particular cases, it may be helpful to introduce additional 
variables, for instance G(r) = sinr is a solution of y = z, z = —y. 

On the other hand, if g(x, y) depends only on y, the slow-fast system (ji]) is equivalent 
to the adiabatic system (||), with G(r) given by the solution of y = g(y). If g depends 
on x as well, this reduction is not possible, but one can sometimes construct a solution 
in the following way: in first approximation, x is related to y by the algebraic equation 
fix, y) = 0. If this equation admits a unique solution x = x*(y), y(r) may be approximated 
by a solution of the equation y = g(x*(y),y), which can be used in turn to estimate 
corrections to the solution x(r) ~ x*(y(r)). 

2.2 Adiabatic Systems and Vector Fields 

We can exploit the similarities with slow-fast systems to obtain valuable informations on 
the solutions of the adiabatic system (|3|) without any analytical calculation. This is done 
by using geometric properties of vector fields. For simplicity, we consider the case of a 
scalar parameter A E M . 

It is always possible to write @ as a vector field by considering the slow time r as a 
dynamic variable: 

^ = f(x,G(r)) 
dt =£ - 

A major drawback is that this vector field has no singular points. One can however deduce 
some general properties of the flow. When f(x,G(r)) 7^ 0, orbits have a large slope of 
order e^ 1 , due to the short characteristic time of the fast variable x. On the other hand, 
when fix, G(t)) = 0, the vector field is parallel to the r-axis. In fact, in a neighborhood 
of order e of an equilibrium branch, the motion of the fast variable becomes slow: it is the 
region where adiabatic solutions (also known as slowly varying states) may exist. 

In the case i£M (n = 1), the form of the vector field (||) imposes strong constraints on 
the solutions. It is possible to show, using only geometric arguments, that some solutions 
will remain in the neighborhood of equilibrium branches of / (Fig. |j). We will see that 
this property can be generalized to the n-dimensional case. 

There are two particular classes of functions G(r) for which it is possible to say more: 
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Figure 4. Solutions of the equation ex — f(x,X), for A(r) = r [here, the function / 
is given by f(x, A) = (x — sin(7rA)/2)(A — x 2 )]. The curves on which f(x, A) = (thick 
lines) delimit regions where the vector field has positive or negative slope. This imposes 
geometrical constraints on the solutions. In the left half of the picture, there exists a 
stable equilibrium branch. Solutions lying above this branch are decreasing, while those 
lying below are increasing. From this construction, one can already deduce existence of 
adiabatic solutions, remaining close to the equilibrium. For a special parameter value, 
there is a bifurcation: the equilibrium becomes unstable, and new stable branches are 
created. In this case, adiabatic solutions coming from the left follow the lower branch. 

Monotonous case 

If G(t) is strictly monotonous, it admits an inverse function G^ 1 . We may thus use 
A = G(t) as a dynamic variable, giving 



If G'{t) goes to zero in some limit, fixed points may appear in the vector field. 

Consider for instance the case G(t) = thr. Then g(X) = 1 — A 2 vanishes at A = ±1. As 
r goes to infinity (A — > 1), trajectories will be attracted by stable fixed points of f(x, 1). 
We conclude that if A moves infinitely smoothly from an initial to a final value, we can 
construct a smooth transformation which compactifies phase space, and in this way the 
asymptotic limit r — > oo can be properly defined (Fig. |5|a). 

Periodic case 

Assume G(t) is periodic, say G(t) = sinr. We can write the adiabatic system in the 
form (H), with the particularity that r can be considered as a periodic variable (i.e., the 
phase space has the topology of a cylinder). Since the flow is transverse to every plane 
r = constant, dynamics can be characterized by the Poincare section at r = (say), 
and its Poincare map T : x(0) h- » x(l). In particular, periodic orbits correspond to fixed 
points of T. In the one-dimensional case, this fact can be used to prove that every orbit 
is either periodic, or attracted by a periodic orbit. 

Of course, to study hysteresis properties, we would like to go back to (A, x)-variables, 
which is done by "wrapping" the (r, x)-space (Fig. |5|b). Some information can also 
be gained by using a representation of the form (jH|) on each interval in which G(t) is 




ex = f(x, A) 
X = g(X) -^G'iG-HX)). 



(6) 
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Figure 5. Same equation as in Fig. f|, but with (a) A(r) = th(r) and (b) A(r) = sin(r). 
In (a), the system admits hyperbolic fixed points at (±1,0), and stable nodes at (1,±1), 
which define the asymptotic states. The stable manifold of (1,0) delimits the basins of 
attraction. In this case, all trajectories reach the lower equilibrium. In (b), during the 
first cycle the solution follows the upper branch, which is still a transient motion. From 
the next cycle on, it is attracted by a periodic orbit following the lower branches. 



monotonous. One should, however, pay attention to the fact that this transformation 
introduces artificial singularities in the vector field at those points where G'{r) vanishes. 

2.3 Some Simple Examples 

Let us return to the example of the damped motion of a particle in a potential, which is 
described by an equation of the form 

d 2 x dx d$, n 

We will show in Chapter 3 that for sufficiently large friction, this system is governed by 
the one-dimensional equation 

dx „ . , s 9$ . 

a ='< X - A > (8) 

Thus, any one-dimensional system of the form 

EX = f(x,\(T)) (9) 

may be interpreted as describing the overdamped motion of a particle in a slowly varying 
potential <J>(x,A(r)), with / ~ — d x &. Let us examine some particular cases, in order to 
illustrate the previously discussed concepts. 

Example 1. Consider the equation 

ex = — x + A(t), A(r)=sinr, (10) 

which describes the motion of an overdamped, adiabatically forced harmonic oscillator. It 
can be solved explicitly, with the result 



x(t) 



x(0) + 



l + £ 2 



e r / £ H 3_.( s i nr _ ecosr). (11) 

1 + e z 
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Figure 6. Solutions of the equation ex — —x + sinr of Example [ij (a) After a short 
transient, the solution x(t) (thick line) follows adiabatically the forcing sinr (thin line), 
with a phase shift of order e. (b) The "Lissajous plot" of this solution in the (A, cc)-planc 
is attracted by an ellipse, at a distance of order e from the line x — A. This cycle encloses 
an area of order e which vanishes in the adiabatic limit, thus we do not consider it as a 
hysteresis cycle. 



The second term is a periodic particular solution of (|10|). It follows the forcing A(t) with 
a phase shift of order e (Fig. ||a). This is precisely what we call an adiabatic solution, 
since it remains in a neighborhood of order e of the static equilibrium x = A(r). In the 
(A, x)-plane, it is represented by an ellipse with width of order e (which can be interpreted 
as a Lissajous plot of the solution), see Fig. ||b. 

The first term in (11) is a transient one, which decreases exponentially fast. In fact, it 



is of order e as soon as t ^ T i{^) = e|lne|. Since lim e _»o r i( £ ) = 0, we may write 

lim x(t; e) = A(r) for r > 0. (12) 

The state of the system is thus determined entirely by the slow variable A. According 
to the discussion of Subsection [L^, we are in a situation without hysteresis, since the 
adiabatic and asymptotic limit commute. Indeed, the physically meaningful procedure 
is to take the asymptotic limit first: we find that trajectories converge to the periodic 
solution x(r, e) = (sinr — ecosr)/(l + e 2 ). Then we see that x(r, e) tends to A(r) in the 
adiabatic limit e — > 0. On the other hand, taking the adiabatic limit directly in ( p!o|) yields 
the correct result x = A(r). 

The fact that all orbits are attracted by a periodic one can also be seen on the Poincare 
map (taken at r = = 2tt), which reads 



T : x 



x + 



l + e' 



and admits a stable fixed point at x* = — e/(l +e 2 ). Let us finally point out that the fact 
that the periodic solution x(r;e) admits a convergent series in e is rather exceptional, in 
general we will only be able to obtain asymptotic series. 
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Figure 7. Equation (]l4|) can be interpreted as describing the overdamped motion of 
a particle in a slowly varying potential of the form shown here. When A < — A c , the 
particle joins the equilibrium a;* (A). For — A c < A < A c , a new minimum a;+(A) has 
appeared, but the particle still remains in the left well. Only at A = A c , when the left 
equilibrium disappears, will the particle join x+(\), which it follows as long as A > — A c . 
For intermediate values of A, the position of the particle depends not only on A(r), but 
also on A(t): the system displays hysteresis. 



Example 2. The equation 

ex = x - x 3 + A(r), A(r)=sinT, (14) 

describes the overdamped motion of a particle in a Ginzburg-Landau type double-well 
potential = —\x 2 + ^x 4 , with an external field A (F ig. ]7|). T his is the most common 
example for hysteresis in ODE found in textbooks [ MR] , |MKfc | . 



Taking the adiabatic limit e — > in (|14D, we obtain the algebraic equation of a cubic 
A = —x + x 3 , admitting stationary points ±(x c , — A c ), where x c = l/\/3 and A c = 2/3\/3- 
When |A| > A c , there is a single solution x*(A), which corresponds to a stable equilibrium 
of the static system. But when |A| < A c , there are three equilibrium curves (two stable and 
one unstable), and it is not clear from this analysis which one the trajectory will follow. 
Let us denote by x+(A) the upper stable equilibrium, and x*_ (A) the lower one. 

Despite its simplicity, equation ( |i~4]) admits no exact solution. But the qualitative 
behaviour of orbits can be easily understood by drawing the vector field in the (r, x)— 
plane (Fig. ||a). Starting for instance at (r, x) = (0,0), the orbit will be attracted by the 
upper branch x+, and follow it until it disappears when A becomes smaller than — A c . If e 
is small enough, the trajectory will quickly reach the lower branch sc* , and follow it until 
A becomes larger than A c again. This behaviour will repeat itself periodically, and it can 
be checked (using only geometric properties of the Poincare map) that the trajectory is 
attracted by a periodic solution x(t; e). We thus obtain an asymptotic cycle, characterized 
by alternating phases with slow and fast motion. Such a solution is called a relaxation 
oscillation. 

When wrapping this solution to the (A, x)-plane, we obtain that 

\x%(\) if A > A c or A > -A c and A < 0, 
lim x(t; e) = < . (15) 

e->0 \x*_(X) if A < -A c or A < A c and A > 0. 

This solution displays the most familiar type of hysteresis. When |A| < A c , the asymptotic 
state (in the adiabatic limit) depends not only on A, but also on its derivative^] 

5 If A(t) is a more complicated function than sinr, admitting several different maxima and minima, it 
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FIGURE 8. Solutions of equation (O), (a) in the (r, x)-plane and (b) in the (A, x)-plane. 
Thin full lines indicate stable equilibria of the static system, dashed lines indicate unstable 
equilibria. These curves are solutions of the equation x — x 3 + \ = x — x 3 + sinr = 0. 
The first representation (a) is useful to draw the vector field. One easily understands 
that the solution follows stable branches until the next saddle-node bifurcation, and then 
moves rapidly to the other branch. We obtain a periodic solution with alternating slow 
and fast motions, called a relaxation oscillation. When this solution is wrapped to the 
(A, ir)-plane, we obtain a familiar-looking hysteresis cycle. In the limit e — > 0, this cycle 
approaches a curve delimited by the equilibrium branches x±(A) and two verticals. 



The limiting hysteresis cycle (Fig. |gb) has a well-defined area, given by the geometric 
formula 



A(0) = 2 f ° <(A)dA. 



(16) 



It is clear from the vector field analysis that A(e) increases with e. In fact, it has been 
shown in |IGRM|1 that 



A(e)^A(0) + e 2 / 3 . (17) 

We will show in Chapter 4 that this exponent 2/3 can be computed in a very simple way, 
using only local properties of the bifurcation points. We point out that in this example, we 
have assumed the amplitude of A(r) to be larger than A c , so that x(t) necessarily changes 
sign. We will examine in Chapter 7 what happens when the amplitude approaches A c . 



Example 3. The equation 

ex = X(t)x — x 3 , A(r)=sinT, (18) 

describes the overdamped motion in a potential $(x, A) = — \\x 2 + \x 4 . In the Ginzburg- 
Landau analogy, the parameter A controls the temperature. The potential has a single 
well at the origin if A < (T > T c , T c being the critical temperature of a phase transition), 
and a double well if A > (T < T c ). In the language of dynamical systems, we have a 
pitchfork bifurcation at A = 0. For positive A, the adiabatic system has to choose between 
two stable equilibria ±y/\ and the unstable origin. 

may require more information than A(r) and A(r) to compute the asymptotic state at time r. In fact, this 
state will depend on the velocity of the last passage of A(r) through ±A C . 
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Figure 9. The potential corresponding to equation ([L8|). For negative A, the particle 
joins the single well at the origin. When this equilibrium becomes unstable, and two new 
wells are formed, the particle does nor react immediately to the bifurcation: it remains 
for some time in unstable equilibrium near the origin. This situation is called delayed 
bifurcation. Finally, the particle chooses a potential minimum, and follows it until the 
minima merge to form a single well again. This system displays hysteresis. 

Equation ( |Ig| ) admits the explicit solution 

x(t q ) e a ( r )/ £ [ T 
x(t) = — :, a(r) := / X(s) ds = cos r — cos r. (19) 




2a{s)/e ds 




It is not straightforward to analyse this solution analytically. Let us consider the special 
case t = — 7r/2, £(t ) = 1. Then 

p — cos r/e 

x(r) = ; = (20) 

e -2coss/ £ ds 

-7T/2 

For — 7r/2 < t < 7r/2, — cost is negative, and the behaviour is governed by the numerator 
e - cos r/e ^ wn j cn j s exponentially small. Thus, the solution remains exponentially close to 
the origin until r = n/2. For negative r, this is not surprising, since the origin is stable. 
Although the origin becomes unstable at r = 0, the trajectory still remains close to it until 
r = 7r/2. This is a simple example of bifurcation delay: the effective bifurcation takes 
place at r = tt/2 rather than at r = 0. In the Ginzburg-Landau analogy, this phenomenon 
may be interpreted as metastability. 

When r > 7r/2, the solution leaves the origin, and, in fact, settles near the equilibrium 
position at x = y/sinr until r = tt, when this branch merges with the origin again. One 
can show (using for instance the saddle point method to estimate the integral in ( p0|) ) that 
x{tt) = 0{e l / A ). If we plot this solution in the (A, x)-plane, we find that the bifurcation 
delay leads to hysteresis, since the trajectory always follows a stable branch for decreasing 
A, but sometimes follows an unstable one for increasing A. 

In fact, the solution analysed here is still a transient one. During the next cycle of 
A, the bifurcation delay is so large that the trajectory ends up by always following the 
origin. But it is sufficient to add an offset to A(r), of the form A(r) = sinr + c, to obtain 
an asymptotic hysteresis cycle as in Fig. |To|b. We will show that its area scales as 

A(s) « A(0) + e 3/4 . (21) 
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FIGURE 10. Solutions of equation ([Tsl), (a) in the (r, a;)-plane and (b) in the (A, x)-plane, 
but for the function A(r) = sinr + 0.1. Thin full lines indicate stable equilibria of the 
static system, dashed lines indicate unstable equilibria. These curves are solutions of the 
equation Xx~ x 3 = 0. When the origin is stable, solutions reach it after a short time. They 
follow the origin for some macroscopic time after it has become unstable, a phenomenon 
known as bifurcation delay. If the solution finally jumps on another equilibrium, we 
obtain a hysteresis cycle. 

Considering the one-dimensional equations studied in these three examples, we observe 
that 

• solutions of a periodically forced system are always attracted by periodic ones; 

• without bifurcations, the periodic solution encloses an area of order e, and does not 
display hysteresis in the adiabatic limit; 

• when bifurcations are present, the periodic solution displays hysteresis, and encloses 
an area which follows a scaling relation of the form A(e) ~ .4.(0) + e**, where \x is a 
nontrivial, fractional exponent. 

One of the goals of this work will be to find out if these properties remain valid for more 
general equations. We will see that asymptotic solutions are not necessarily periodic. 
However, if such a periodic solution exists, its area will usually follow a scaling law of the 
above mentioned form, with an exponent \x which can be computed in a relatively simple 
way. 

3 About this Thesis 
3.1 Objectives 

We pursue two major objectives in this work: 

1. Establish a coherent mathematical framework in order to deal with adiabatic systems 
of the form (||). In particular, we would like to understand the relation between an 
adiabatic system, and the corresponding family of autonomous equations. We are also 
interested in developing some practical tools allowing to establish existence of periodic 
orbits and hysteresis cycles, and to determine their scaling behaviour as a function of 
the adiabatic parameter. 

2. Apply these methods to some concrete examples. This should allow to check their 
efficiency to deal with a given equation, and to detect aspects of the theory which 
need further development. Since many authors, after spending much effort to derive 
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equations describing magnetic hysteresis, analyse them by numerical simulations, we 
would like to show how the theory of Dynamical Systems can be used to obtain valuable 
information on such equations with relatively small effort. 

As we discussed in Subsection |1.3| , much work has already been done on adiabatic systems, 
in particular on bifurcation delay. We feel, however, that this work is worth extending 
in two directions. Firstly, results obtained by mathematicians are often formulated in a 
rather abstract language, which is not easily accessible to the average (even theoretical) 
physicist. Thus it is certainly useful to translate them into a language facilitating their 
application to concrete problems. Secondly, several aspects of the fundamental theory still 
need to be clarified. For instance, hysteresis itself, and the associated scaling behaviour, 
have almost not been studied by mathematicians. We also discovered, when analysing 
particular examples, that several basic concepts still needed to be developed, for instance 
adiabatic manifolds. 

We have chosen two types of applications. The first one, which we call nonlinear 
oscillators, concerns various situations where a damped particle is placed in a slowly 
varying force field. Such low-dimensional Dynamical Systems are interesting for several 
reasons: we have some physical intuition for their behaviour; they are sufficiently simple 
to be analysed in great detail, so that we have a better chance to understand fundamental 
mechanisms of hysteresis; still, some of these systems are known to exhibit chaotic motion 
when forced periodically, and it is important to understand what happens when this forcing 
becomes adiabatic. 

As a second application, we will consider a few models of magnetic hysteresis. This 
program appears to be much more ambitious, since magnets are so complicated systems 
that it is not clear at all whether they may be modeled by finite dimensional equations. 
We think, however, that such an attempt is justified by the mere fact that it will reveal 
both the power and limits of such a kind of modeling. It may give some hints as to what 
characteristics a realistic model should include, and in what directions the theory should 
be extended in order to give more reliable predictions. 

3.2 Philosophy 

In this work, we adopt the point of view of Mathematical Physics. This implies that 
physicists may regard it as an unnecessarily pedantic way of establishing evidences, while 
mathematicians may consider it as a pedestrian approach to a problem, which might be 
described much more nicely using non-standard analysis and Borel series. 

To the former, we would like to point out that there exist numerous examples of 
problems, for which it was considered as evident that their solutions behave in some special 
way, until this evidence was proved wrong by a serious analysis. The precise mathematical 
understanding of a problem is always desirable when it reveals the power and limits of 
an empirical approach. For the latter, we would like to underline that our work aims at 
providing a method of practical use, allowing the physicist to obtain useful information 
on a concrete adiabatic system, with a minimum of technical tools. 

There are different approaches to Mathematical Physics. One of them relies on ex- 
act solutions. We believe that this approach is useful as far as it provides very precise 
information on a particular model equation, which is assumed to be generic. There are, 
however, two major drawbacks: Firstly, differential equation which can be solved exactly 
are very scarce, so that only very few model equations are likely to be analysable in this 
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way. Secondly, even when a system has been solved exactly, the interesting features are 
not immediately apparent, and it may require a lot of hard analysis to derive them. This 
approach does not favour the physical intuition, and often yields incorrect interpretations]^] 

A good illustration of these difficulties is provided by Example ||: this system is still 
relatively simple to solve, if one knows about Bernouilli's equation. But it turns out that 
the important phenomenon, namely bifurcation delay, can also be obtained in a much 
simpler way, by studying the linearized equation ex = A(r)x. The behaviour of solutions 
far from the origin can be analysed by different methods, that do not depend on the 
detailed form of the nonlinear term, which is necessary for the equation to be exactly 
solvable. We will show that even the scaling law (|2l]) can be obtained using only a local 
analysis around the bifurcation point. 

We will thus prefer those methods which favour the physical intuition. To analyse 
some complicated equation, one has to understand first which terms are important, and 
which terms have a negligible influence. Then one starts by solving the simplified equation 
containing only the important terms. Perturbative methods are often well adapted so such 
a procedure. 

But one has to be careful not to confuse perturbation and approximation. It is very 
tempting (and often done) to assume that a solution can be written as power series of 
some small parameter, to insert this series into the equation, and to solve it for the first 
few orders. This procedure is often dangerous, since these power series do usually not 
converge.^ In fact, it is better to apply perturbation theory to the equation than to its 
solution. 

We will often proceed in two steps. Firstly, we will derive an iterative scheme that 
allows to decrease the order of some remainder in the equation, which prevents us from 
solving it. Secondly, we have to prove in an independent way that the influence of this 
small remainder on the solution can be bounded. Thus, if we write that a solution contains 
a remainder R = 0{e), we mean something very precise: namely there exist positive 
constants c and e such that \R\ ^ ce for < e ^ e . These constants are independent of 
£ and could be computed explicitly (although this computation may turn out to be quite 
cumbersome). 

Once such a bound on the remainder is known, when applying the theory to a concrete 
example one can forget about the proof of the second part, and use the iterative scheme 
to determine the behaviour of the solution at leading order in the small parameter. It 
appears that the bounds c and e are often far too pessimistic, and that, at least for finite 
dimensional systems, the asymptotic theory provides rather accurate information for fairly 
"large" values of the "small" parameter. 



3.3 Reader's Guide 



There are different ways to write a Ph.D. dissertation. One can choose to present a 
summary of the major results, or one can give a more detailed account with background 
information on the subject and complete proofs. We preferred the second possibility. 
We believe that such a detailed presentation is justified for the kind of subject we have 



A startling example of such a misunderstanding is found in AC1], who analyse an equation linearized 

around an unstable equilibrium, which is never reached by the solution. 

7 For instance, the perturbative analysis of a Hopf bifurcation in [ME1, BER fails to reveal the phe- 
nomenon of maximal delay. 
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Figure 11. Logical organization of the chapters. Arrows indicate that a chapter relies on 
the contents of another one, in an essential way if the arrow is thick. 

been working on, which lies on the boundary of Mathematics and Physics, provided the 
structure of the text is sufficiently apparent. 

Although the chapters of this dissertation are not self-contained, we tried to write 
them as far as possible in an independent way. Thus it is certainly not necessary, in order 
to understand the contents of a given chapter, to have read all the preceding ones. 

Roughly speaking, Chapters 2 and 3 present some aspects of mathematical and physical 
theory which are already well known. Chapters 4 and 5 are dedicated to the abstract, 
mathematical theory which we have developed to deal with adiabatic Dynamical Systems. 
Chapters 6 and 7 provide applications of this theory to some concrete examples. Chapter 
8 contains extensions of some results to iterated maps. 

Chapter 2: Mathematical Tools 

We present some important notions from the theory of Dynamical Systems (as equilibrium 
points, stability and Lyapunov functions, invariant manifolds, bifurcations and normal 
forms), and some elements of analysis which are used in the proofs (Banach spaces, Frechet 
derivatives, asymptotic series and differential equations). The notations we use do in 
general not differ from standard ones. This chapter should be considered as a reference 
chapter, and the reader who is already well acquainted with the theory, as well as the 
reader who is not interested in detailed mathematics, can safely skip it. 

Chapter 3: Physical Models 

We describe some physical concepts on which rely the examples discussed in Chapters 6 
and 7. The damped motion of a particle in a potential serves as paradigm for a wide 
class of Dynamical Systems. We discuss the most common models for ferromagnets at 
equilibrium and out of equilibrium, and show how to derive a deterministic evolution 
equation from the governing master equation. Finally, we briefly present some existing 
phenomenological models of hysteresis. 

Chapter 4: One Dimensional Systems 

We present a detailed mathematical framework to deal with one-dimensional adiabatic 
equations of the form ex = /(x,r). We first discuss the properties of adiabatic solutions, 
which are particular solutions remaining close to non-bifurcating equilibria, and admitting 
asymptotic series in the adiabatic parameter e. We then analyse in detail the dynamics 
near bifurcation points, in particular the way how they scale with e. We provide a simple 
geometrical method, based on the Newton polygon, to determine the scaling exponents. 
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Finally, we discuss some global aspects of the flow, in particular how to determine periodic 
orbits, and the e-dependence of hysteresis cycles. 

Chapter 5: n Dimensional Systems 

We extend results of the previous chapter to n-dimensional equations. The discussion of 
adiabatic solutions is quite similar to the ID case. We then examine the linear equation 
eij = A(t)i/, which describes the linearized motion around an adiabatic solution. This is a 
rather lengthy task, but we show that the problem of diagonalizing such an equation can 
be transformed into the problem of finding adiabatic solutions of an auxiliary equation. 
This transformation allows to treat eigenvalue crossings and bifurcations in a unified way. 
Next we develop some tools to deal with nonlinear terms, in particular adiabatic manifolds 
and dynamic normal forms. Finally, we examine some global properties of the flow. 

Chapter 6: Nonlinear Oscillators 

We consider different examples involving the damped motion of a particle in a slowly 
varying potential. The most important one is equivalent to a simple physical system, 
namely a pendulum on a table rotating with slowly modulated angular frequency. This 
system displays two important phenomena: a bifurcation delay leading to hysteresis, and 
the possibility of a chaotic motion, even for arbitrarily small adiabatic parameter. We use 
the methods developed in Chapters 4 and 5 to compute an asymptotic expression of the 
Poincare map, which allows to delineate precisely the parameter regions where hysteresis 
and chaos occur. The other two examples discussed in this chapter illustrate the effect of 
eigenvalue crossings. 

Chapter 7: Magnetic Hysteresis 

We discuss a few simple models of ferromagnets in a slowly varying magnetic field. When 
the interaction between spins has infinite range (i.e., in a Curie- Weiss type model), the 
dynamics can be described in the thermodynamic limit by a low-dimensional differential 
equation, of Ginzburg-Landau type. We examine the phenomenon of dynamic phase 
transition for ID spins, and the effect of anisotropy on the dynamics of 2D spins. Finally, 
we explain why models with short range interaction are much harder to analyse, and 
present a few simple approximations. 

Chapter 8: Iterated Maps 

We extend some of the previous results to adiabatic iterated maps. We start by showing 
that some basic properties of adiabatic ODEs, such as existence of adiabatic solutions and 
the behaviour of linear systems, can be extended to maps depending on a slowly varying 
parameter. We conclude by presenting some results on existence of adiabatic invariants 
for slow-fast maps, and illustrate them on a few billiard problems. 
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